Systems configured to control digital characters utilizing real-time facial and/or body motion capture and methods of use thereof

ABSTRACT

In some embodiments, the present disclosure provides an exemplary technically improved system and method for controlling the body movements and facial expressions of a digital character in real time by using: a body-motion capture system comprising a headset configured to be worn on a head of a user and comprising controllers and sensors that can be used to track at least one head or body motion of the user (including arms and hands); and correspondingly control at least one head or body motion (including arms and hands) of a digital character in real time based, at least in part, on the captured motion data; a mobile computing device configured to track and capture facial expression data relating to at least one facial expression of the user, and use at least that data to correspondingly control at least one facial expression of the digital character in real time; a microphone configured to capture an audio output of the user, and control an audio output of the digital character in real-time based, at least in part, on the captured audio output; an integration computing device configured to integrate the audio output, the motion data and the facial expression data to control the audio output, the motion, and the facial expression of the digital character; a vest configured to be worn on an body of the user and a structural member attached to the vest and configured to hold the mobile computing device at a predetermined distance from a face of the user so that the mobile computing device can track and capture the at least one facial expression of the user.

COPYRIGHT NOTICE

A portion of the disclosure of this patent document contains materialthat is subject to copyright protection. The copyright owner has noobjection to the facsimile reproduction by anyone of the patent documentor the patent disclosure, as it appears in the Patent and TrademarkOffice patent files or records, but otherwise reserves all copyrightrights whatsoever. The following notice applies to the software and dataas described below and in drawings that form a part of this document:Copyright, Capital One Services, LLC., All Rights Reserved.

FIELD OF TECHNOLOGY

The present disclosure generally relates to systems configured tocontrol digital characters (e.g., avatars) utilizing real-time facialand/or body motion capture and methods of use thereof.

BACKGROUND OF TECHNOLOGY

Existing motion tracking and/or motion capture systems may include theuse of live actors and puppets or require the use of expensive andspecialized equipment beyond the reach of the average consumer. Existingsystems may also be typically unable to accurately and closely captureboth the facial expressions and body movements of a user in a seamlessway to animate and control the facial expressions and body movements ofa digital character in real time.

SUMMARY OF DESCRIBED SUBJECT MATTER

In some embodiments, the present disclosure provides an exemplarytechnically improved kit comprising: a body-motion capture systemcomprising: a headset configured to be worn on a head of a user; atleast one motion-detection sensor located at a predetermined distancefrom the user to track at least one head or body motion of the user; atleast one controller configured to control at least one head or bodymotion of a digital character; where the body-motion capture system isconfigured to: track and capture motion data relating to at least onehead or body motion of a user; and control at least one head or bodymotion of a digital character in real time based, at least in part, onthe captured motion data; where the at least one head or body motion ofthe digital character corresponds to the at least one head or bodymotion of the user; a mobile computing device configured to: track andcapture facial expression data relating to at least one facialexpression of the user, and control at least one facial expression ofthe digital character in real time based, at least in part, on thecaptured facial expression data; where the at least one facialexpression of the digital character corresponds to the at least onefacial expression of the user; a microphone configured to: capture anaudio output of the user, and control an audio output of the digitalcharacter in real-time based, at least in part, on the captured audiooutput; where the audio output of the digital character corresponds tothe audio output of the user; an integration computing device that isconfigured to integrate the audio output, the motion data and the facialexpression data to control the audio output, the motion, and the facialexpression of the digital character; a vest configured to be worn on anbody of the user; and a structural member attached to the vest; wherethe structural member is configured to hold the mobile computing deviceat a predetermined distance from a face of the user so that the mobilecomputing device can track and capture the at least one facialexpression of the user.

In some embodiments, the present disclosure provides an exemplarytechnically improved method comprising: receiving motion data relatingto at least one head motion of a user from a headset and from at leastone sensor configured to track and capture at least one motion of a headof a user; receiving motion data relating to at least one body motion ofa user from at least one controller and from at least one sensorconfigured to track and capture at least one motion of a body of theuser; receiving facial-expression data relating to at least one facialexpression of a user from a mobile computing device configured to trackand capture at least one facial expression of the user; receiving audiooutput from a microphone configured to capture an audio output of auser; integrating the received head and body-motion data andfacial-expression data to control at least one head, body motion, andfacial expression of a digital character in real time based, at least inpart, on the received motion and facial expression data such that the atleast one head, body motion, or facial expression of the digitalcharacter corresponds to the at least one head, body motion, or facialexpression of a user; and integrating the received audio output tocontrol an audio output of the digital character in real-time based, atleast in part, on the received audio output; such that the audio outputof the digital character corresponds to the audio output of a user.

In some embodiments, the present disclosure provides an exemplarytechnically improved kit comprising: a body-motion capture systemcomprising: a headset configured to be worn on a head of a user; atleast one motion-detection sensor located at a predetermined distancefrom the user to track at least one head or body motion of the user; atleast one controller configured to control at least one head or bodymotion of a digital character; where the body-motion capture system isconfigured to: track and capture motion data relating to at least onehead or body motion of a user; and control at least one head or bodymotion of a digital character in real time based, at least in part, onthe captured motion data; where the at least one head or body motion ofthe digital character corresponds to the at least one head or bodymotion of the user; a mobile computing device configured to: track andcapture facial expression data relating to at least one facialexpression of the user, and control at least one facial expression ofthe digital character in real time based, at least in part, on thecaptured facial expression data; where the at least one facialexpression of the digital character corresponds to the at least onefacial expression of the user; a microphone configured to: capture anaudio output of the user, and control an audio output of the digitalcharacter in real-time based, at least in part, on the captured audiooutput; where the audio output of the digital character corresponds tothe audio output of the user; an integration computing device that isconfigured to integrate the audio output, the motion data and the facialexpression data to control the audio output, the motion, and the facialexpression of the digital character; and an apparatus worn on the bodyof the user and configured to hold the mobile computing device at apredetermined distance from a face of the user so that the mobilecomputing device can track and capture the at least one facialexpression of the user regardless of the movement of the user.

BRIEF DESCRIPTION OF THE DRAWINGS

Various embodiments of the present disclosure can be further explainedwith reference to the attached drawings, wherein like structures arereferred to by like numerals throughout the several views. The drawingsshown are not necessarily to scale, with emphasis instead generallybeing placed upon illustrating the principles of the present disclosure.Therefore, specific structural and functional details disclosed hereinare not to be interpreted as limiting, but merely as a representativebasis for teaching one skilled in the art to variously employ one ormore illustrative embodiments.

FIGS. 1A, 1B, 2A, 2B, 3A, and 3B depict one or more schematic flowdiagrams, and/or pictures that are illustrative of some exemplaryaspects of at least some embodiments of the present disclosure.

DETAILED DESCRIPTION

Various detailed embodiments of the present disclosure, taken inconjunction with the accompanying figures, are disclosed herein;however, it is to be understood that the disclosed embodiments aremerely illustrative.

Throughout the specification, the following terms take the meaningsexplicitly associated herein, unless the context clearly dictatesotherwise. The phrases “in one embodiment” and “in some embodiments” asused herein do not necessarily refer to the same embodiment(s), thoughit may. Furthermore, the phrases “in another embodiment” and “in someother embodiments” as used herein do not necessarily refer to adifferent embodiment, although it may. Thus, as described below, variousembodiments may be readily combined, without departing from the scope orspirit of the present disclosure.

In addition, the term “based on” is not exclusive and allows for beingbased on additional factors not described, unless the context clearlydictates otherwise. In addition, throughout the specification, themeaning of “a”, “an”, and “the” include plural references. The meaningof “in” includes “in” and “on.”

It is understood that at least one aspect/functionality of variousembodiments described herein can be performed in real-time and/ordynamically. As used herein, the term “real-time” is directed to anevent/action that can occur instantaneously or almost instantaneously intime when another event/action has occurred. For example, the “real-timeprocessing,” pertains to the performance of a computation during theactual time that the related physical process (e.g., a user interactingwith an application on a mobile device) occurs, in order that results ofthe computation can be used in guiding the physical process.

As used herein, the term “dynamically” and term “automatically,” andtheir logical and/or linguistic relatives and/or derivatives, mean thatcertain events and/or actions can be triggered and/or occur without anyhuman intervention. In some embodiments, events and/or actions inaccordance with the present disclosure can be in real-time and/or basedon a predetermined periodicity of at least one of: nanosecond, severalnanoseconds, millisecond, several milliseconds, second, several seconds,minute, several minutes, hourly, several hours, daily, several days,weekly, monthly, etc.

As used herein, the term “user” shall have a meaning of at least oneuser.

As used herein, the term “headset” or the like, may refer to anyportable electronic device that may or may not be enabled with bodytracking functionality and that may be worn or mounted on the head of auser. For example, a headset can include, but is not limited to, ahead-mounted display, virtual reality headset, or any other reasonableheadset that may be enabled with body tracking functionality. Anon-limiting example of a headset may include an Oculus Rift™ headsetwhich is manufactured by Oculus VR (owned by Facebook Technologies LLC,CA)

As used herein, the term “mobile computing device” or the like, mayrefer to any portable electronic device that may or may not be enabledwith facial expression and motion tracking functionality (e.g.,Augmented Reality Kit™, ARKit™, or the like by Apple Inc., CA) includingrelevant software and hardware. For example, a mobile computing devicecan include, but is not limited to, a mobile phone, Smartphone, or anyother reasonable mobile electronic device enabled with facial expressionand motion tracking functionality. A non-limiting example of a mobilecomputing device may include an iPhoneX™ manufactured by Apple Inc., CA.

As used herein, the term “integration computing device” or the like, mayrefer to any electronic computing device that is able to among otherthings receive and process, audio, body, and facial expression andmotion capture information and data to control the audio, body, andfacial expression and motion of a digital character. For example, an“integration computing device” may include gaming laptops or computersand may or may not include software or applications for rendering orcontrolling digital characters such as the UNITY™ (Unity Technologies,CA) application. In some embodiments, the exemplary integrationcomputing device may also include software or applications foroperating, calibrating, and/or configuring the headset, controllers,and/or sensors.

Examples of software may include software components, programs,applications, computer programs, application programs, system programs,machine programs, operating system software, middleware, firmware,software modules, routines, subroutines, functions, methods, procedures,software interfaces, application program interfaces (API), instructionsets, computing code, computer code, code segments, computer codesegments, words, values, symbols, or any combination thereof.Determining whether an embodiment is implemented using hardware elementsand/or software elements may vary in accordance with any number offactors, such as desired computational rate, power levels, heattolerances, processing cycle budget, input data rates, output datarates, memory resources, data bus speeds and other design or performanceconstraints. A non-limiting example of software may include an OculusRift™ application package or software programs.

The material disclosed herein may be implemented in software or firmwareor a combination of them or as instructions stored on a machine-readablemedium, which may be read and executed by one or more processors. Amachine-readable medium may include any medium and/or mechanism forstoring or transmitting information in a form readable by a machine(e.g., a computing device). For example, a machine-readable medium mayinclude read only memory (ROM); random access memory (RAM); magneticdisk storage media; optical storage media; flash memory devices;electrical, optical, acoustical or other forms of propagated signals(e.g., carrier waves, infrared signals, digital signals, etc.), andothers.

In accordance with one or more embodiments of the present disclosure,FIG. 1A illustrates a block diagram of an exemplary User Station 100 andFIG. 1B illustrates a block diagram of an exemplary Audience Station200.

In some embodiments, referring to FIGS. 1A and 1 , a user may operatethe system from a User Station 100. The User Station 100 may bephysically separated from an audience that is located in an AudienceStation 200 such that the user may be invisible to the audience. Forexample, the User Station 100 and the Audience Station 200 may betypically located in different rooms such that the user may not able tophysically see the audience or the Audience Station 200, and such thatthe audience may not able to physically see the user or the User Station100. For example, the Audience Station 200 and the User Station 100 maybe in different rooms of the same building, or may be located at a largedistance from each other, such as in different cities or countries.

As shown in FIG. 1A, the User Station 100 may include a mobile computingdevice 101 that includes an application, software or functionality thatmay be capable of tracking and capturing the facial expressions andmotion of a user to control a digital character in real time. In someembodiments, mobile computing device 101 may include computing devicesthat typically connect using a wireless communications medium such ascell phones, smart phones, pagers, radio frequency (RF) devices,infrared (IR) devices, CBs, integrated devices combining one or more ofthe preceding devices, or virtually any mobile computing device that mayuse an application, software or functionality to track and capture thefacial expressions and motion of a user to control a digital characterin real time. A non-limiting example of a mobile computing device inaccordance with one or more embodiments of this disclosure may includeis an iPhone X™ that may include an ARKit™ app (both by Apple Inc., CA).

As shown in FIG. 1A, the User Station may also include a headset 102,controllers 103, and sensors 104 a and 104 b that may be capable oftracking and capturing the body motion of a user, who may be operatingthe controllers and wearing the headset, to control the body motion(including hand movements) of a digital character in real time. Anon-limiting example of headset 102, controllers 103, and sensors 104 aand 104 b may include an Oculus Rift™ virtual reality headset,controllers, and sensors (Oculus VR).

As shown in FIG. 1A, the User Station 100 may also include an exemplaryintegration computing device 105 that may include a software programthat allows the rendering and control of digital characters. Forexample, the integration computing device 105 may be a desktop computer,gaming laptop, PDA, tablet or other computing device. The softwareprogram that allows the rendering of digital characters may include theUNITY™ software program or application (Unity Technologies, CA). In someembodiments, the integration computing device 105 may also include aprogram or an application to configure and operate the headset 102,controllers 103 and sensors 104 a and 104 b which may be electronicallyconnected to the integration computing device 105 either physically orwirelessly. The headset 102, controllers 103, and sensors 104 a and 104b, may also be calibrated and configured through an application orprogram on the integration computing device 105. The integrationcomputing device 105 may further include a user interface/electronicvisual display that is configured to inter alia, allow the user to seethe audience in-real time, and/or to see the digital character ascontrolled by the user and displayed in real time to the audience.

As shown in FIGS. 1A and 1 i, the User Station 100 may further include atransmitter 106 that may be able to send relevant signals to a receiver204 in the Audience Station 200; and a microphone 107 that may allow theuser to input audio that is received in the Audience Station as theaudio output of the digital character. The User Station 100 may alsoinclude a sensor 108 (not shown in FIG. 1A) to receive signals from acamera 201 that may be located in the Audience Station 200.

As shown in FIG. 1B, in some embodiments, components of the kit andmethod that are present in the Audience Station 200 may include at leasta receiver 201, an electronic visual display 202, a camera 203, amicrophone 204, and a speaker 205. The electronic visual display 202 mayallow an audience to see and interact with a digital character or avatarthat is being controlled by the user (who may be invisible to theaudience) in real time. Non-limiting examples of the electronic visualdisplay 202 may include a MicroTile video display system, a TelevisionSet, a Smart TV, a computer, a mobile computing device, a smartphone, orany comparable electronic visual display. The camera 203 that is placedin the Audience Station 200 may act as the “eyes” of the user andprovide a real-time video feed of the audience to the user such that theuser can see the actions of the audience and react to those actions inreal time. The camera 203 may include a web camera or any device withreal-time video capability. The microphone 204 may allow the audience tospeak to the digital character in real time such that when the audiencespeaks the invisible user controlling the digital character from theUser Station 100 (FIG. 1A) can immediately hear the audience and respondto the audience such that it appears that the digital character isresponding to and interacting directly to the audience. The speaker 205may allow the audience to hear the audio input of the invisible user asthe audio output of the digital character in real time. The camera 203,microphone 204, and speaker 205, may be integrated with the electronicvisual display 202. The receiver 201 may receive relevant inputs fromthe User Station 100 and Audience Station 200 including the transmitter106. (FIGS. 1A and 1 ).

In accordance with one or more embodiments of the present disclosure,FIGS. 2A and 2B further depict illustrative components of a User Station100 (FIG. 1A). As shown in FIGS. 2A and 2B, in some embodiments, themobile computing device 101 may be held at a predetermined distance fromthe face of the user through various methods. In one embodiment, themobile computing device 101 may be physically supported at apredetermined distance from the user's face in the holder of a selfiestick that may be configured to be attached to a vest.

As shown in FIG. 2B, in some embodiments, the controllers 103 may beheld in each hand of a user and may be configured to be tracked bysensors 104 a and 104 b (FIG. 1A). Sensors 104 a and 104 b may also becapable of tracking the movements of headset 102. (FIGS. 1A, 1B, 2A and2B.) Each of controllers 103 may include several buttons, triggers, andcontrols that may also be configured to control certain actions of thedigital character. (FIGS. 1A, 1B, 2A and 2B.) Sensors 104 a and 104 bmay be set up at a predetermined distance from each other and from anintegration computing device 105, and when in operation, a user mayoperate sensors 104 a and 104 b, controllers 103, and headset 102 withina predetermined physical boundary (such as a portion of a room) withinwhich sensors 104 a and 104 b can sense controllers 103, headset 102, orthe user's body movements. (FIGS. 1A, 1B, 2A and 2B.)

As shown in FIGS. 1A, 1B, 2A and 2B, sensors 104 a and 104 b forcontroller 103 and headset 102 may be placed at a predetermined distancefrom an integration computing device 105 and the user. In oneembodiment, integration computing device 105 and sensors 104 a and 104 bmay be mounted on a movable rack such that re-calibration of the systemis not required when the rack is moved. For example, sensors 104 a and104 b may be attached to and/or held in place by movable mechanical“arms” attached to the rack and folded out of the rack at predeterminedangles, and subsequently locked into place during operation of thesystem, such that when the rack is moved during operation, there is noneed to re-calibrate either the sensors 104 a and 104 b or theapplication (e.g., Oculus™-like type application) that is running on theintegration computing device 105. The movable mechanical arms holdingsensors 104 a and 104 b may be folded back into the rack when the systemis not in operation.

The user's facial expressions may be tracked by the mobile computingdevice 101 which may be held at a predetermined distance from the user'sface by a selfie stick and may be attached to a vest.

In accordance with at least some embodiments of the present disclosure,FIGS. 3A and 3B depict the front and side-view of a user who may wearheadset 102 (FIG. 1A) at an angle to the user's forehead.

In accordance with one or more embodiments of the present disclosure, anexample of an animated digital character, nicknamed DJ Bee™ whose bodymotions and facial expressions may be controlled in accordance with theprinciples of the present invention and which is used to teach childrenabout money including whether to save, spend, or share. In someembodiments, the DJ Bee™ character may be presented to a user on a userinterface/electronic visual display/computer screen of integrationcomputing device 105 (FIGS. 1A, 1B, 2A and 2B) and/or on electronicvisual display 202 (FIG. 1B) that may be controlled in accordance withthe principles of this disclosure.

An example of one of the embodiments of the present disclosure maycomprise the following. To begin the presentation/performance, a greetermay welcome an audience comprising children to an Audience Station thatis equipped with an electronic visual display 202, a microphone 204, aspeaker 205, a web camera 203, and a receiver 201 in accordance with theprinciples of this invention. (FIG. 1 i ). The audience may bepositioned in front of electronic visual display 202 and web camera 203(FIG. 1B) and may be prompted by the greeter to call for DJ Bee™ toappear. In response, the animated DJ Bee™ character may appear on theelectronic visual display 202 (FIG. 1B) and interacts with the audiencein real time. Based on the placement of the web camera 201, microphone204 and speaker 205 at the Audience Station (FIG. 1 ), DJ Bee™ is ableto “see, hear and talk to” the audience in real time and react toanything related to the audience in real time (although in reality, itis actually the invisible user controlling the digital character fromUser Station 100 (FIGS. 1A, 1B, 2A, 2B, 3A, and 3B) who is interactingwith the audience). Since the user and User Station 100 (FIGS. 1A, 1B,2A, 2B, 3A, and 3B) remains invisible to the audience throughout thepresentation, this real-time interaction with a digital character on anelectronic visual display 202 (in Audience Station 200) (FIG. 1B) thathas natural human body movements and facial expressions appearssurprising to the audience since the audience may not be used tointeracting with an animated digital character on an electronic visualdisplay in such a conversational and ordinary way. As described above,this interaction, which appears as magic to the audience is in fact, acarefully orchestrated mapping of a behind-the-scenes user's body andhand motions and facial expressions to the digital character's body(including hands) and facial expressions in real time in accordance withthe principles of this invention.

Behind the scenes (for example, in a separate room), a user may operatethe system and method in a User Station 100 (FIGS. 1A, 1B, 2A, 2B, 3A,and 3B) in accordance with the principles of this invention such thatthe user's body movements and facial expressions are tracked and mappedonto the animated character. As an example, when the system is inoperation, the user may wear a headset 102 on the user's forehead (FIGS.2A, 2B, 3A, and 3B); and may hold and control a controller 103 in eachhand (FIGS. 1A and 2B). The user's body, hand and head motions may betracked by the sensors 104 a and 104 b at the User Station (FIGS. 1A,2A, 2B, 3A, and 3B) and mapped in real-time onto DJ Bee's™ body, handand head motions. A non-limiting example of a headset, controllers andsensors in accordance with one embodiment of this invention is an OculusRift™ virtual reality headset, controllers, and sensors made by OculusVR.

With the aid of the video-feed supplied by camera 203 (FIG. 1 ), theuser in User Station 100 sees the actions of the audience on the userinterface of the integration computing device 105 and speaks to theaudience through a microphone 107 at the User Station (FIGS. 1A, 2A, 2B,3A, and 3B). The user's facial expressions may be tracked by anapplication or software on a mobile computing device 101 that may beheld at a predetermined distance from the user's face and mapped onto DJBee's™ face as DJ Bee's™ facial expressions in real time. A non-limitingexample of a mobile computing device may be an iPhone X™ operating anARKit™ software application (Apple, Inc., CA).

In one embodiment, mobile computing device 101 may be held at apredetermined distance from the user's face in the holder of aselfie-stick that may be attached to a vest worn on the user's body(see, e.g., FIGS. 2A, 2B, 3A, and 3B). In another embodiment, mobilecomputing device 101 may be held at a predetermined distance from theuser's face in a holder on a rig that is configured to be worn on theuser's body. In one embodiment, the rig may conclude PVC pipes and abody suit. In another embodiment the rig may be a vest that isconfigured to be worn on the user's body and to hold the selfie sticksuch that the mobile computing device can track the user's facialexpressions closely and regardless of the user's movements. (See., e.g.,FIGS. 2A, 2B, 3A, and 3B).

The advantages of the system and method disclosed herein over existingsystems include the following: the present invention is a relativelyinexpensive kit and method with natural and intuitive controls, that iseasy to set up, and which is readily available to an ordinary consumerto capture both the body and facial expressions of a user in a seamlessway to control the body and facial expressions of a digital character inreal time, with no additional training required for the user. The systemand method are based on the user's natural and fluid real-life movementsexpressions, not gestures or partial gestures, and enables non-technicalpeople to control a digital character in real time. Further, the systemdisclosed herein does not need a set of pre-defined microposes tooperate. It is therefore easier and faster to substitute in differentavatars into this system using other 3D models and rigs. This system andmethod do not also need to map interactor gestures; instead the user andavatars movements are natural and intuitive based on natural bodymovements, therefore no extra preparation time is required to set upthis system.

In addition, all actions take place in real-time and do not require anypost-production clean up. In contrast to certain existing solutions, thesystem and method disclosed herein is able to handle raw motion captureand the transmission of a substantial amount of network data to controla digital character over a wired or a wireless connection. Due to thepositioning of the mobile computing and the use of the facial trackingand mapping software at a predetermined distance from the user's facethroughout operation in some embodiments, the system is able to capturethe entire facial expression of the user including the user's eyesregardless of how the user moves including whether the user sits,stands, or places their head on a chair. Further, this system does nothave a need for reflective markers for spatial reference and there is noproblem with occlusion by markers by the user's body since the systemdoes not rely on the use markers. There is also no need for a user tointeract with or control unwieldy puppets in order to attempt to controla digital character and there is no need for several puppeteers and anactor to work together to control various aspects of a single digitalcharacter. The cognitive load of the user is limited as the user nolonger needs to worry about controlling a puppet and following a complexstory line at the same time but is instead free to naturally move aroundpredetermined boundary in exactly the way the user desires.

At least some aspects of the present disclosure will now be describedwith reference to the following numbered clauses.

1. A kit comprising:

-   -   a body-motion capture system comprising:        -   a headset configured to be worn on a head of a user;        -   at least one motion-detection sensor located at a            predetermined distance from the user to track at least one            head or body motion of the user;        -   at least one controller configured to control at least one            head or body motion of a digital character;    -   wherein the body-motion capture system is configured to:        -   track and capture motion data relating to at least one head            or body motion of a user; and        -   control at least one head or body motion of a digital            character in real time based, at least in part, on the            captured motion data;        -   wherein the at least one head or body motion of the digital            character corresponds to the at least one head or body            motion of the user;    -   a mobile computing device configured to:        -   track and capture facial expression data relating to at            least one facial expression of the user, and        -   control at least one facial expression of the digital            character in real time based, at least in part, in the            captured facial expression data;        -   wherein the at least one facial expression of the digital            character corresponds to the at least one facial expression            of the user;    -   a microphone configured to:        -   capture an audio output of the user, and        -   control an audio output of the digital character in            real-time based, at least in part, on the captured audio            output;        -   wherein the audio output of the digital character            corresponds to the audio output of the user;    -   an integration computing device that is configured to integrate        the audio output, the motion data and the facial expression data        to control the audio output, the motion, and the facial        expression of the digital character;    -   a vest configured to be worn on a body of the user; and    -   a structural member attached to the vest;        -   wherein the structural member is configured to hold the            mobile computing device at a predetermined distance from a            face of the user so that the mobile computing device can            track and capture the at least one facial expression of the            user.

2. The kit of clause 1, wherein the headset is configured to be worn ona forehead of the user.

3. The kit of clause 1, wherein the headset is configured to be worn ona forehead of the user at an angle of 15 to 45 degrees above eyes of auser.

4. The kit of clause 1, wherein the headset is configured to be worn ona forehead of the user at an angle of 20 to 35 degrees above eyes of auser.

5. The kit of clause 1, wherein the headset is a virtual realityheadset.

6. The kit of clause 1, wherein the mobile computing device is a mobilephone.

7. The kit of clause 1, wherein the structural member attached to thevest is a selfie-stick.

8. The kit of clause 1, wherein the headset is a virtual realityheadset, the mobile computing device is a mobile phone, and thestructural member attached to the vest is a selfie-stick.

9. The kit of clause 1, wherein at least one controller is held in ahand of a user.

10. The kit of clause 9, wherein the at least one motion-detectionsensor tracks the at least one controller held in the hand of the user.

11. The kit of clause 10, wherein the at least one motion-detectionsensor tracks at least the headset and the at least one controller heldin each hand of the user.

12. A method comprising:

-   -   receiving motion data relating to at least one head motion of a        user from a headset and from at least one sensor configured to        track and capture at least one motion of a head of a user;    -   receiving motion data relating to at least one body motion of a        user from at least one controller and from at least one sensor        configured to track and capture at least one motion of a body of        the user;    -   receiving facial-expression data relating to at least one facial        expression of a user from a mobile computing device configured        to track and capture at least one facial expression of the user;    -   receiving audio output from a microphone configured to capture        an audio output of a user;    -   integrating the received head and body-motion data and        facial-expression data to control at least one head, body        motion, and facial expression of a digital character in real        time based, at least in part, on the received motion and facial        expression data such that the at least one head, body motion, or        facial expression of the digital character corresponds to the at        least one head, body motion, or facial expression of a user; and    -   integrating the received audio output to control an audio output        of the digital character in real-time based, at least in part,        on the received audio output; such that the audio output of the        digital character corresponds to the audio output of a user.

13. The method of clause 12, wherein the motion data relating to atleast one head motion of a user is received from at least tracking aheadset configured to be worn on a forehead of a user.

14. The method of clause 12, wherein the motion data relating to atleast one head motion of a user is received from at least tracking aheadset configured to be worn on a forehead of a user at an angle of 15to 45 degrees above eyes of a user.

15. The method of clause 12, wherein the motion data relating to atleast one head motion of a user is received from at least tracking aheadset configured to be worn on a forehead of a user at an angle of 20to 35 degrees above eyes of a user.

16. The method of clause 12, wherein the motion data relating to atleast one head motion of a user is received from at least tracking avirtual reality headset.

17. The method of clause 12, wherein the facial-expression data relatingto at least one facial expression of a user is received from at least amobile phone.

18. The method of clause 12, wherein the motion data relating to atleast one head motion of a user is received from at least tracking avirtual reality headset, and wherein the facial-expression data isreceived from at least a mobile phone.

19. The method of clause 12, wherein the motion data relating to atleast one head motion of a user is received from at least a plurality ofsensors, and wherein the facial-expression data relating to at least onefacial expression of a user is received from at least a mobile phone.

20. A kit comprising:

-   -   a body-motion capture system comprising:        -   a headset configured to be worn on a head of a user;        -   at least one motion-detection sensor located at a            predetermined distance from the user to track at least one            head or body motion of the user;        -   at least one controller configured to control at least one            head or body motion of a digital character;    -   wherein the body-motion capture system is configured to:        -   track and capture motion data relating to at least one head            or body motion of a user; and        -   control at least one head or body motion of a digital            character in real time based, at least in part, on the            captured motion data;        -   wherein the at least one head or body motion of the digital            character corresponds to the at least one head or body            motion of the user;    -   a mobile computing device configured to:        -   track and capture facial expression data relating to at            least one facial expression of the user, and        -   control at least one facial expression of the digital            character in real time based, at least in part, in the            captured facial expression data;        -   wherein the at least one facial expression of the digital            character corresponds to the at least one facial expression            of the user;    -   a microphone configured to:        -   capture an audio output of the user, and        -   control an audio output of the digital character in            real-time based, at least in part, on the captured audio            output;        -   wherein the audio output of the digital character            corresponds to the audio output of the user;    -   an integration computing device that is configured to integrate        the audio output, the motion data and the facial expression data        to control the audio output, the motion, and the facial        expression of the digital character; and    -   an apparatus worn on the body of the user and configured to hold        the mobile computing device at a predetermined distance from a        face of the user so that the mobile computing device can track        and capture the at least one facial expression of the user        regardless of the movement of the user.

Any publications cited throughout this document are hereby incorporatedby reference in their entirety. While one or more embodiments of thepresent disclosure have been described, it is understood that theseembodiments are illustrative only, and not restrictive, and that manymodifications may become apparent to those of ordinary skill in the art,including that various embodiments of the inventive methodologies, theinventive systems/platforms, and the inventive devices described hereincan be utilized in any combination with each other. Further still, thevarious steps may be carried out in any desired order (and any desiredsteps may be added and/or any desired steps may be eliminated).

What is claimed is:
 1. A system, comprising: a non-transient computermemory storing computing instructions of a software application; atleast one processor that, when executing the computing instructions ofthe software application, is configured to: receive, from at least onemobile computing device of a user, at least: motion data related to atleast one head motion of the user, at least one body motion of the user,or both, facial expression data related to at least one facialexpression of the user, and an audio output of the user; render themotion data of the user, the facial expression data of the user, orboth, into at least one motion of a digital character, at least onefacial expression of the digital character, or both, so to control, inreal-time, a video output of the digital character in a presentation toan audience; combine the video output of the digital character with theaudio output of the user; and instruct to display on a display to theuser, a real-time video feed of the audience captured by a video camerato cause a real-time interaction between the audience and the digitalcharacter controlled by the user during the presentation.
 2. The systemof claim 1, further comprising: a vest configured to be worn on a bodyof the user; a structural member attached to the vest; wherein thestructural member is configured to hold the at least one mobilecomputing device at a predetermined distance from the user.
 3. Thesystem of claim 2, wherein the structural member attached to the vest isa selfie-stick.
 4. The system of claim 1, further comprising at leastone controller; and wherein the at least one controller is held in ahand of a user.
 5. The system of claim 4, wherein the at least onecontroller comprises at least one button, at least one trigger, at leastone control, or any combination thereof for controlling actions of thedigital character.
 6. The system according to claim 1, furthercomprising a movable rack and at least one motion-detection sensor; andwherein the at least one motion-detection sensor and the at least oneprocessor are locked on the movable rack at fixed positions to preventrecalibrating the software application, the at least onemotion-detection sensor, or both, when the movable rack is moved.
 7. Thesystem according to claim 1, further comprising an audience station. 8.The system according to claim 7, wherein the audience station comprisesan audience display, an audience station microphone, an audience stationspeaker, and the video camera; and wherein the audience is positioned infront of the audience display and the video camera.
 9. The systemaccording to claim 8, wherein the audience display displays the videooutput of the digital character; and wherein the audience stationspeaker outputs the audio output.
 10. The system according to claim 1,further comprising a Virtual Reality headset configured to be worn on aforehead of the user; and wherein the at least one processor isconfigured to receive, in real time, the motion data from the at leastone mobile computing device related to at least one motion of theVirtual Reality headset.
 11. The system according to claim 1, furthercomprising an integration computing device.
 12. The system according toclaim 11, wherein the integration computing device comprises the atleast one processor that is configured to integrate the audio output,the motion data and the facial expression data of the user to controlthe audio output, the at least one head motion of the user, the at leastone body motion of the user, the at least one facial expression of thedigital character, or any combination thereof.
 13. The system accordingto claim 1, further comprising at least one motion-detection sensorconfigured to capture the motion data related to at least one motion ofa Virtual Reality Headset, the at least one head motion of the user, theat least one body motion of the user, at least one motion of at leastone controller, or any combination thereof, and wherein the at least oneprocessor is further configured to receive the motion data from the atleast one motion-detection sensor.
 14. The system according to claim 1,wherein the at least one mobile computing device is a smartphone. 15.The system according to claim 1, wherein the software applicationcomprises a UNITY™ software program.
 16. A method, comprising:receiving, by at least one processor, from at least one mobile computingdevice of a user, at least: motion data related to at least one headmotion of the user, at least one body motion of the user, or both,facial expression data related to at least one facial expression of theuser, and an audio output of the user; rendering, by the at least oneprocessor, the motion data of the user, the facial expression data ofthe user, or both, into at least one motion of a digital character, atleast one facial expression of the digital character, or both, so tocontrol, in real-time, a video output of the digital character in apresentation to an audience; combining, by the at least one processor,the video output of the digital character with the audio output of theuser; and instructing, by the at least one processor, to display on adisplay to the user, a real-time video feed of the audience captured bya video camera to cause a real-time interaction between the audience andthe digital character controlled by the user during the presentation.17. The method of claim 16, further comprising instructing, by the atleast one processor, to display on an audience display to the audience,the video output of the digital character combined with the audiooutput.
 18. The method of claim 16, further comprising controlling, bythe at least one processor, actions of the digital character through atleast one button, at least one trigger, at least one control, or anycombination thereof on at least one controller controlled by the user.19. The method according to claim 16, further comprising receiving, bythe at least one processor, the motion data captured from at least onemotion-detection sensor.
 20. The method according to claim 19, whereinthe receiving of the motion data by the at least one motion-detectionsensor comprises receiving the motion data related to a motion of aVirtual Reality Headset configured to be worn on a forehead of the user,the at least one head motion of the user, the at least one body motionof the user, at least one motion of at least one controller held in ahand of the user, or any combination thereof.